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(54) IMAGE DISPLAY 
DEVICE FOR VEHICLE 

(57) Abstract 

PROBLEM TO BE SOLVED: To 
provide an image display device 
for vehicle which can produce 
synthetically and display images 
properly from scene to scene 
which the vehicle encounters. 

SOLUTION: Cameras 3-1 thru 
3-8 are installed in/on a vehicle 
to photograph a plurality of 
images simultaneously, and they 
are quantized in A/D conversion 
parts 5-1 through 5-8 and stored 
in image memories 7-1 thru 7-8 
to serve for preparing a plurality 
of images, and one of a plurality 
of vehicle operating conditions is 
selected by a vehicle condition 
instructing part 1 1 and instructed. 
On the basis of the instructed 
operating condition, the acquired 
images are deformed and 
synthesized so that a new image 
is produced by an image 
deforming/synthesizing part 1 3 f 
and the produced image is 
displayed on a monitor 1 7. 
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rawss 3 ] mammz • 

xfciirmiamzm-zmm, miMM^noms, ni§ 
lwsv <Dm*Mffi<z>£.x<Dmm tt< n— as 

5is*« i xtt 2 fa^^iMfflB^a^Bo 

[0 0 0 1 ] 

[0002] 

li, «;ttt!WWPP8 - 8 5 3 8 
fa\1hfvtz.$*y*m^X2ftfawm&fez.. r^Bft 

So 

[000 3] 

[0004] a£5©*?5fflJSIH*=* S/^y-AjWtffl^T 



au^v^S3&Sit7J^?*«r*.e>n*. nil 
[0005] *»Wf±, ±iadBfr-cft*nfct>«)-c» 

[0006] 

[ooo7] m#m. 2 ssML<omwte. ixe&m&fm-t 

-f skims* ■ t , r 
[0008] nw«S3ett^BniL iieiss^^-r 

[0009] IS*«4|E^<^BJ(i. ±lEHM*ft?^:-t- 
[00 10] 

(DWmoymMM(n o h i Lxm^M-^o 

^$nfci^?r^7rrr^ ^ t x\ W£tm\cfc zxmm 

[00 11] $.tc, ffi*«2f5®W*fgB^JC«tHtf, * 
50 agB--&J*LT#fctt!Wfc*:£»*U ^»M$nfc» 
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^^m.(D^^\zm:^xm.^r : b<ox\ mm^tz 4oroyp y 1 1 3 -a- i 3 -D&mmztix^z. 

ttfxzzo frbm&A,mm&m&ztix^z>w&**v 

[ooi2] ate. m*m3%m<o*muz£tu-£, m x*¥ • sttr Ku^^Jt^tf 5 D 

m*w&^xmm\zm£m-z>m&, %mmm lx (ooisi ftftftiai, r vv- 1 3 - 1 x 

<OfgV ^^-^it A®® W^ffi <b U< tt-gflO ^fflLUT 13-2 (/Vy * T vfy—zf)^) . 

^ffifelctomfc^fc^ ' ^tH"S ^ <b S 0 3-4 \C i oTJt^^nSiii^> ^7-l~7-8(^ 

[oo i 3] *tc. ff*S4ieifeo*^^«tnji, «t 70 M^Ku^o^-^iSBE^a^H-r— ttoBrflkic** 

# £ Mzmk<r>Mk*^fr?w®5-\zmfctz> t. 0 $k d/a^^p 1 3 - 6 ^xwmm^m&z 

m - &j&i.xmtz*imz£jfrtz>^tx, mmvtzm *vc*=* 1 7 fc**s*ts. mm\xx -m-r kv* 

iB»lc3fi^S:^S^'W!^*^*-«*1"S-t 1LUT13-3, tt7 K^fflLUT 1 3-2,^ 

^ ^ ^ ^-y-feu^^fflLUTi3-4li, ^h/?Jx-&ri&&i*9 

[0 0 14] ® £ [5] C1M X(73^MXgil:N(73 2 V frhffi 

[WA<»m®mm ur. *ftw<n3mmmzmm issn-c^s. *?7K^fflLUT© (x, 

umirXtmrz. y> ^* A * htk^ailuto (x, y ) \cm 

mi<om&<mm mux b, ^y-tw^fflLUTo (x, y ) ^c^h 

mmzm*mmmmiw<nmm:7t?tmx»>z>. m r sn-cv ^t-rzt. ^ytw?i3-5 tmm 
mizjfrrzoi^ m^m^ftm^mmix 20 ^tyc^t^m -g-fiaa^o^ (x, y ) \z. 
tc^g$n, p^t-r=&^?r»^-r5isigc^/7 3 HMt>*y coass (a, b) ^vr^tdm 

- 1-3-8 1, **7frb<Dwm?r*A/'DW&-r mt)£}nz>o 

6»sw> A/Daaaas 5-1-5-8 A/Dmm i o o 1 9 ] mzsx ^w&jftfmnm&ixx - 

I^Oili^^y 7-1-7-8 9 tC**U. 5o C<7)fc«\ ^£»OiSlftl4> I2l4(c^ e fc9^«|fi)c 

X*&94X>?*Wm*Z>*'l%i'*V~*^-9S ZtiZ>Zki>m$.\,\<\ '&-?X. *¥7K^fflLU 

im#mmm*MAmt>\ fm&BMwm\ t, M7K^iLUT, ^y-tw^fflLUT 
nt, tttsMzMWMB&s txim<vm&*$a& 30 ®.<Dwm^^wx<kimfa<»{m.%®mirz> mx 

^1 5t36»P>«Sc$n-CV^S. [0 0 2 0] rWipJC, i\,y9Tv7T—-fA'*n^ 

[0015] m 2 -m 4 £#f]B loo, ^Piffle* xmm-mt • &i$rfz> - 1 t% #j;t^ Eft^^ 

- ^ *s^>S/«C*iffi^iffiS Lfd&S-Ktt, HI 2 JctjH" «t 5 ^^tfe^3tH*7r^ t tr 5 ^ t &X$ Z> e 

|C N «^^fl^t^l l©^^f/^WLTS [0 0 2 1] ^yt^^fflLUTl3-4 

ux im0>mmMk^x<D&immMvvmswi ])&^&T*-tx£ntz.w&\ax -mm.t\^xmx.a 
1-1 1. mmmm?^Amsw 1 2-2 1. mm^. 40 roj «rW7j-rs«t5^L-c*5i-ttf, s4jo-j^r«tp 

^cSlSWi i-3h ^iiL^v^55M,*iiAfc^SWl tc, ^^pB^lcg$Pi«rA0^7t^Sr»5r t^"ef , 
i-4i^ y ^»<*/u±te*i-3 t^-efc5)„ i *Pn t ilffl wfigM^^ J: "9 BJ5S»ci-^ ^ t &X% 

[0 0 1 6] ilic, ^iI*«Aii^filSWl l-l -5. 
«fe LTjSW. Lfc#^^*Plfflf!*{t!i^fiWSM^l^ [00 2 2] C (O^^, E 4 JCtitT ± 9 (C s 

«as<qspK«BB*» l l Wttil*^An«filSW l l - -T* ^ t #X2 zam&WT U&£Kli, M» 
1 Lfc«^»ctt. vmmM&fm l 3 *sgBi*J»A r^-C 1 5 Srif LT, ^17 -^^Sr^*-f 

[0 0 17] R^^-^^ 1 3li, H3{C7j^-«k9 [0 0 2 3] CrT\ IB^^F^^gRl 3W$*«l^i 
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fc4o<oyn->^ 1 3-A~l 3-D#ffljR3iVCV> 
■So JKBtftiJ^Sfl 1 1 TiSR^ftfcy n y ? fi, 

[0024]I»li > 7KU^*^13-1T 
5i%*ixfc^dtaf«iroflS«tl (x, y) KttU *¥7K 
U^fflLUTl 3-3, SittT K^fflLUTl 3- 
2, ^^UtU^^lLUT 1 3-4{ClioTfB^$iX 

^£ix5. WftllcMk *spTK^fflLUT (H (x, 
y) ) 13-3, SjttTKV^fflLUT (V (x, 
y) ) 13-2, ^^yt^^fflLUT (S (x, 
y) ) 13-4li, ^m*¥MXftffN<0 2&7t;;>< 

X-CfoS. 3\ 7K¥T Kl/^fflLUTO (x, y) Idffi 
A, SlTK^fflLUT (x, y) leffiB, >*yir 
^?fflLUTO (x, y) icmCfrXhT£frX\,^Z> 

u ttm&nmk (x, y ) ic«, »*yc©i 
« (a, b) hT$4x^fit^m^^n-5o 

[0 0 2 51 fttc, @5^7jTf-7c3— h^rffll/^ 

[0026] £1\ ^fy/S 1 OTii, ^:il*J*AiX -?0 
f y^l 1-1 «rjf Lfc^ti-rSo rtU-^LT, 

&mm&f$&i z<nydmm*M,m-7v v* 1 3 -a 

/SW^nSo W-v *xs/7°S2 0T-te, 

13-1 »cJ:-o-C, -a-^iS^wfiiET KMtr, 

y = i 

[0 0 2 7] ^fy7S3 0m 7K^#? 

x=l ^ 

^fflLUT 1 3-3(OfilHl (x, y) «tf*HBU 
a=Hl (x, y) 

IC-fe 3/ M"-5 0 r aWteftfc*W K W^ffl L U 
Tli, B^^^gpi 3©7o-^ 1 3-AlCjRLT 

v^Tcife, hi (x. y) tmztz>o mmz. 7w 

2 13-B, 13-C, 1 3-D(CJSi-^)7K¥T KU-^ 

fflLUT«*tV*fftH2 (x, y) , H3 (x, y) , 

H4 (x, y) tmmZftZo 50 
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[0028] y7S50 Til ±-yb £*tfc 

fflLUTl 3-2<OfitVl (x, y) £r$fiBU 
(J=V1 (x, y) 

Tli, S*&g3&£fi£g& 1 3CD1 3-A:7a^(CJSLT 

v^rc*, vi (x, y) tmztZo mm\c. 

2 13-B, 13-C, 1 3-Dlzm-fZ>Ss\M.T Vis* 
fflLUTIi-?:ixmV2 (x, y) , V3 (x, y) , 
V4 (x, y) £*IE£ix5o 
[0029] 7.7- y-/S 6 OTii, -fe v b Zfrtz 

^fflLUT13-4©tSl (x, y) £r#!8U 
y = Sl (x, y) 

Tl*, ftfMB0drittVl 3©7d->^ 1 3-A(CJSUT 
V>5fc«>, SI (x, y) ir*te-T-5o iBttHl-, 

^13-B, 13-C, 1 3-Dicji-rs^y-fei--^ 

*fflLUTtt-*ft*IXS2 (x, y) , S3 (x, 
y) , S4 (x, y) kmW.£tlZ>* 
[0 0 3 0] ^fy/S 7 OT'Ji, ±IE^.-r y7°S4 0 

W (x, y) ^tH7Ji-?>flISr^-r-5o wtUi, #^7^ 
7BM^ hT^-5fc*lcfflE£*tft#iB{£^yMi 
(x, y) , M2 (x, y) , — , M8 (x, y) 
LTMv (a, e) *mi-fZ^t\cl:oXfr? 0 Mtft 
y#S0>®&t;^y<£>, 7K¥7KW-^a, Sit 

T, ®^$nrcffi»i, ^B»0 (x, y ) ^, 

O (x, y) =My (a, 3) 

[003 1] ^(C, 8 0T-»±, ^iSaHftO* 

7K>pT KU^^MlC^bfc^tC^^s/T-S 1 0 0\C 
V ->7S9 0 t-iitf. Xf^7S9 0-C 

li, KU**yf y ^ ^ h b, S^t" y^S 

4 0 

[0 0 3 2] ^Ty7S 1 0 OTii, -a^;i®^7K¥T 
K l^^.*Slv»cJi Lfc^-^, SET K dSNI^ji Lfc 

^fy7S 1 2 0{ciitfo — SiST K^^Nirjg 
LX\<^&^W&\a**7-y7*S 1 10lciitf o ^7^7 

5 1 1 OT'tt, ^riattMOSlT K^^NfC^LTV^ 

^f y-fS 3 0tcM-5o 
[0 0 3 3] ^ry7S 1 OOlcfc^T, -n-RScH 
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Oi^ £fm@LO (x, y) i^SU D/Af^Sl 
3-6^riiLT*-^ 1 7|ca^$iX'5o 3te#f4, * 

3>jMI*7 \Jzmz&7mT*<( 1 5 ^frr„ 
[0 0 3 4] ~ -"C\ 1 2 OT-fi, ^RfeS7 

-5„ *4y7\ 53Wf£Jxfcv*£fcli» fit** 

T, SiSTK^fflLUT, ^JJ-fcl'^fliLUT 
J4, -«vWv ^<^J5^fkW#<btl-5J:5t^£L-C 

[0 0 3 5] &tz, El4ic^LfcJ;9tc: x -^•fiHS^-S 

-4tC, #£L&V^^y#^£S#iM/T**5#, *<D 
^^■US^r^-fe^.$iXfcB#li, — J^ffi (0iJ^LliO) 

[0 0 3 6] ^2^ gfitWAttfKMsSWl 1-2% 

#A*mtttttt>ftv 1 1 <D$immm.7^Am s w 1 1 - 
2 *jf Lfc^^ti, B^ffe^-^^ 1 3 a-mmmmA 
twm\mm£tiz>o 30 

[0037] Mii*«Atu^«gwm»-fi. Httfc, * 
i*i«#<©ttf«i: *4SiHW<^f«i rwfc 
^aoiBffttt. El6fc^4?»d#j££;}x5;L,h 
i«a*LV\ i£oT, foW-T K^fflLUT, fiffiTK 
u^fflLUT, ^y-fcu-^fflLUTtt, tts&n* 
HI 6 iot^-J; 9 te&i&Mfo&nbinZ 4 9 WBB£ lt*j 

[0 0 3 8] do&m, vmmz&mi 314, ±sel 

fctiWcttBfeU 1 7K^£ixSo a 

-cDi5f-LT^e^^ 1 7±K^£ixfceWfe 

[0 0 3 9] »3»C, a^'llttWfllSWl l-3«r»f£ 
7jk& 1 l Og^iJ!li*^figS W 11-3 £i¥Lfc&£lC 50 
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14, tmmz£f$2$ 1 3iwe*wi»-ia3t$ns. 
[0040] mm&tmrti&i^ nst, 

^J«m<oiij^l4, El 7 (c^i-<£>4 9 tefftfcSitS d 
t*«a*U\ ^oT, if*W7 K^fflLUT, SET 
KU^fflLUT. ^JJ-feW^JflLUTtt* *h*h, 
HI 7 5 &6AMfc*#&i'i& 4 5 Jcl££LT*5 

[0041] zLvmnis w&mtivmi 314, 

[0042] jK 4 ic, ^ii Lco^v ^^JciiAi-^^ 

iswn-4 x^xmi Ltzm&<Difmmymm 
tz.m&ia-£, ymmz&i&m 3riSjtiiLtf>jg^£^,6 

[0 0 4 3] aiib<7?SV^5^i.fCjtALfc#^tCI4, 

ifcoT, 7k¥TK^fflLUT, S 
CTK^fflLUT^ ^*yirWi5'^fflLUT»4, -th, 

^tc*tiS#ttT-^^ilj^4B?rESi-?>*^4, «^tc 
[0 0 4 4] r.O*SJft, |AfM5^aiSl 314, 

[0 0 4 5] I©J:7lC, *(36){C|Sfi$nfc*^5 3- 

i~3-8^^T, mttcmcwttfo&mt&Lx. * 

tV?tlA/Dm&M 5-1-5-8 X-m^tLtz^k^ 

mm* 7- 1-7-8 (ciem t-ciiico?^^^# 
1S^:w*isi<Dil©bcfil<D9tio^*:B^ 

tzwmm\zg^^^x, wmztiitim<ryim&m$ ■ 

^L-C*ffc<tt*tt*l!*tt©^riaiJl ST'^L, Z 
■fZ>z\kfcX'£Z> a 
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[0046] WffifflWfctm.vtt£&**y<wk 

10 0 4 7] £<btc:, W&OgM. -&ffiiJ\>y9TyZf 

[0048] &2<nm&<oMim i29te. *&m<Dm 

HIT-*?"?, Elio»i, ym$S&^f$M i3©yo-7^i 

* 5 i-, mgmz-^im 1 3 ic < to-r^^n./c^t 

#&*^5^|&cd*=* 1 7-l~l 7-4£*3Sirt 
.£ ? K Lfcr <k (cfc-5„ *fc, m 1 0 ic^-T £ 5 

1 <vm&mmt mmmxibz <nx% zomi&gte 
[oo4 9] ei o^tjqui i^#rslt, vm 

»&fSSS 1 3 <oBBNBJWi**fft8W-*_ B10, Bl 30 

i (c^-r«t o ic, mem&&&&> 1 3 ici*, sqswwigm 

jf:*P 1 1©4 li<D7^ y^KttJE LT, 4 o©/o y 
? 1 3-A~l 3-D;65JSm$*t"CV^o GtZfuy? 

e^Sft-cvs. *P?WIBS^»1 lTilW^tLfc^ 

[0 0 5 0] JWWttCfi* fflxliT KW- 1 3 
- 1 - 1 T'^ £ nfc£fdc«fe<ai£SI fit (x, y) 4» 
L, K^fflLUT 13-3-1, SKT Kl"* 

fflLUT13-2-l, ^*y-feW*fflLUT 1 3- 
4 - 1 ICfcoTfi^ftSH®^ * !J 7-1-7-4CO 

J&iS&te, ^LUT Kg^$nfcD/A'£&gB 19-1 
-19-4 ic J;oT8WWtWcaE**K 1 7 - 

1 — 1 7-4»cS^£ft5o 

[00 5 1] 1 7 - 1 W£tt3;IVCVS 

BHfcSSI^fifcSB 1 3©^n yt> 1 3 -A - 1 ICOl^C, 

ffl®<o»ax«jyMH-a. *¥t k^luti3-3 50 



-1, ISTK^fflLUTl 3-2-1, ^^y-feU 
**fflLUTl 3-4- Hi, £-J&^i®&i:|5}— 

[0 0 5 2] 3\ *?7K^fflLUTl 3-3- 1© 
(x, y) KffiA, SittTK^fflLUTl 3-2-1 
CD (x, y) ICfllB, ^t!)t^^lLUT13-4 
-1© (x, y) icfitca^ •tiVen^hT^ixTV^ 
>*y-feU^^l 3-5-H4Bft^*yc 
fc-fcu-;? m -&j£iHte£>MSI (x, y) (cfi, 
*yctf>Mt£ (A, B) fc*hT£ftfcll»m&£*L 

So 

[0 0 5 3] 121 2~E11 5Sr#fiaLoo, 

[0 0 5 4] ^11-, milWAtubcflgSWl l-l£ 

^a^m^m^^ 1 1 (vm&M&Mv&M s w n- 
lSrjfL^^ctt, m^m^fm 1 3WntA 

#17-4 JCfi, Hi 2 tCTfrT J; 5 ^^1ft^*:*i7rr1" 
[0 0 5 5] ^<om, *¥7K^1LUT, SittT K 

LUTyni/^A©lft©^l 3-A-4£r{5y&f 

~Mfe5VMil~Ntl^>{i?rir2/ hLTfc^ ft&W 

[0056] ?^*5, El 1 5 Ufc J: 0 ^fSM^ 
^•5o Ztt»i^*lHrU^^fflLUTl 3-4-4{c, 
T?±x£ixtzm*. -^ffi (mtfO) Sr#tiatfi 

[0057] tl±, ^ii*mAnB#cOS«^i, IWWBK 
&fimi 3-A-4(C^tLT, ia5{C7Jvt-7D-^-Y- 
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vms^n 1 1 <offi&$m**vvmsw i 1 - 2 &*¥ 

[0 0 5 8] iliJii^AixtfmS-lc^ m£$3V&J$M 

I 3^Sf|ii^*Anffl{c-fe-2/ h£tL5 0 «t!ii**Aia* 

m^w^x-hz. z<Dtc$>, mi 3\zftf-£o^ ate 

y^BOHSftwyoy^ 1 3-B-l, 2, 3£{£ 
[0 0 5 9] iSl£#{i, w<^>J;5tClLT^$ttfcB^ 

[0060] ^3ic, ^jK^^-^ui^-rso m<i 

I I <^jiii*^sswi 1-3 s-m-o wmsM&tiic. 

ynj/^U-C-l, 2, 3, 4&&ffl-r5„ wOT 

[0061] iBb#& z<D£o\zLxma<£fttdyim 

^^T^-fy^-l 5^rJfLT, ^--^ib*^^* 

im#.mm^ 1 1 lsv ^m>MA*msw 1 

i-4^}fi- 0 

[0062] r (DW&ia-t. MmB&f$£!> 1 3 tfjUi 



ot, 5E^«B@^BS.5SI8-r5. r<0«tp/«C^ Hi 
UT % Si£T KU-^fflLUT, ;*^-y-fe ^fflLUT 
13-D-2, 3£feffl-T5. w<7)^ {Eft^U^ 

[0 0 6 3] iSfgtfi, ~(Di5lCLT^$ixfcBWt 

r WtdlSfi^tl-fc* ^73-1-3 

A/D^&&5-l~5-8T*HfcL7tt£U:. 
*y7-l~7-8 lc|5tS U-ca««0|Wfc«:»» bT*J 

3 T'^fiK U -<D^^tbfcB^^gtW^= ?17- 
1-1 7-4iC^$-frT^7jH-5roT\ SSbfc^B 

[0 0 6 4] $e>t-*7t, ^^7y/f- 

^o-C, ^Jx.»i4-fe<o^^7T-*iiSi±)lia**=-^i"^) 

[Ell] *^^iw^J£ojf^c^6*iS)ffl^S 
[fa 2 ] &ffiftffi&7f;%V> 1 1 <Z)^-< y?-'<*A't&tiW 

[ia 3 ] *:p^fii^&p nw4 ^o^-r y^-fc^ 

L"C, B*»^-&^P1 3(^(C4ocoyp->^ 1 3-A 
~1 3-D^fflS$txTV>Sri:$:S-na-efoS„ 

[B4] saa«*7J^Wfeot^(c*=^»c*^*n5 

[115] ^il^AtU^«Siffl[^ffi^^^<^iW^5r 
[E 6 ] tm*&Mv#!&nm&\z*~fi lc«^ $tt5 
[El 7 ] ^ill£¥^fl|co^(c^- ^ $ 
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